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ABSTRACT 


The Ptiepose or this thesiseils tor de tc misc me meen emiems 
relationship, through computer simulation, between the 
parametric ANOV and non-parametric Wilson tests under con- 
mrmlled conditions of error non-normality. 

Data Voesinudaced wsame the 12 cell factorial ANOYV 
mecel with three levels of factor A, four levels of factor 
Mmiiosme ObSe€rvations per cell. Interaction is Charac- 
meepzed Such that ats effect 1s proportional to the effect 
imeactor A with the constant of proportionality related to 
meemer 6b, Non-normality of the error term 1S characterized 
Mmmmenree dIStribution types: Skéwed, leptokurtic (peaked), 
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tribution types are utilized, each related to the Pearson 
jomly of frequency curves. 

inree erOouUSiieescVCumImmared SECLS Of dala are veneraced 
meme acn degree Of error type. Power is then estimated di- 
meeely for both the ANOV F tests and Wilson Chi-square tests 
momemain effects and interaction. Comparison is then made 
Metween Corresponding tests showing the effect of error 


Mom-nornality on the power of each. 
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Tl ee NRO CT iON 


ie. PEARSON'S STUDY OF NON-NORMAL VARIATION 

The normality of error assumption is a well known re- 
quirement when using Analysis of Variance (ANOV) techniques. 
imeeoas been Shown, however, thatgthis requirement msgnot 
aaemmecnt when only type I error 1s the point of concern: 
Meameertcrature does suggest that error normality as a ae- 
quirement relative to type II error and correct determination 
@eepower Of the test. 

Pearson se) | studiedMerrormion-normality for a case ai 
volving the one way ANOV classification. His study was 
Priscd on the distribution of the correlation ratio m* which, 


- 
4 


. : ¢ _4 ms ser 5 2 int. Sf , (dob Fo ‘ : T 5 
Meee, wWaGeCQUuIValGmt to ikke F statistic. Si» eas “ca 
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tributions were chosen with non-normality of error charac- 
terized by Pearson coefficients 8, and 8,’ and by Pearson 


curve type*. Those chosen were: 
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= 0.99 6B, = 3.83 (Type I, very skew with abrupt start). 


Mearson concluded that the distribution of n°, and therefore 


* Reference 2 defines these coefficients as 8, = w3/us: 


ee ot /u5, where u. represents the ith central moment. 


2 Reference 3 transforms the 13 curve types of Reference 
fermto prebability density functions. 








Gt Fi, within the range of the above six disctrubmer once 
quately met the s"normality of error” requil remen tesa) 9 mess 1c 
oie Varliances He further concluded that within thikse ene 
Giese would =beslrttlewchance cCipm@ej|cetine aatnue Tia pace 
esis because of non-normality, but that in the extreme cases 
of non-normal variation there would always be a danger of 
a@ecepting a false null hypothesis. Thus, Pearson suggested 
mmo extreme cases of error non-normality may result Gm a 
Heamction of power in the F test. He @hereby raised the ques- 
miemeas to how error non-normality would affect the F test 
emer) tOr a particular ANOV design. 

Kirk [4], citing the above study by Pearson (1931) and 
a study by Norton as reported by Lindquist [5], extended 
etteeen' S COnciusiom relating to type i error to ali rixed- 
Cuacems ANOV models utilizing the F distribution. Kirk held 
img. In general, unless the departure from normality as so 
eeaeremce tiwat it can be readily detected by viswal inspection 
femme data, the departure will have little effect on the 
Pmooabselity associated with the test of significamce (type 
mereronmemiowever,elairk madesno referemee to the etfect of 


Merenormality on the power of the test. 


IBS A NON-PARAMETRIC ANOV TEST 

The problem of meeting the error normality assumption 
mere using the parametric ANOV F tests is avoided by choosing 
Meon-parametric test. A search ot the literature was made 
to find such a test which included a non-parametric method 


mouebesting interactions in the ANOV model. Wilson [6] 








developed such a test, based on the Chi-square fagcerdoene ne 
for testing hypothesis in two-way, three-way ,edne com wee, 
ANOV designs. The test procedure, applicable only to fixed 
easects modelisjeinvolves classifying the scores @imeeach 

eel as abeve or below the overall median and using the face 
mere a total Chi-square, like a sum of squares, can bievde- 
composed into additive parts. A new set of formulas are in- 
meocguced for workingéiwith factorial designs in Chi-square 
memmis, A description of the test including the Chi-square 
formulas is contained in Appendix A. 

Sheffield [7] showed how the Wilson test could be con- 
wemved to a conventional ANOV procedure, whereby the Wilson 
Sieeecauare formulation could be replaced with “non-parametric 
Bee SUS . 

lewemar |/8| contrasted the outcomes Of ermculllsonmrase 
Paaemie Parametric F test on seven batches of data, each in- 
femevineg two-way classification. Based on 21 comparisons (A, 
B, and AxB effects) he suggested that the power of the Wilson 
tests was lower than what could be reasonably expected. How- 
ever, McNemar failed to determine what constituted "reason- 
eemee" power for the Wilson test. In addition, he based his 
Sonclusions on a small sample which he admittedly assumed 
met the parametric ANOV requirements of normality and homo- 
Paiacity. fo the author's knowledge, the literature docs 
not report any other attempt to obtain an indication of power 


mor tie Wilson Chi-square tests. 








Ce Pee hOB IN 1 ERG anon 

Williams [9] studied the problem of amterpie eameeenc 
efrects of different factors when those effects are moa 
@ibeive. 9 He pointed out that attention must be pad tro etic 
way in which the factors interact. He suggested that a rea- 
femable assumption, in the two factor case, was to consider 
mmm tiie interaction effect was proportional to the effect 
oaemone factor with the constant of proportionality related 
Mempnhe second factor (i.e.., (06) 55 = Ug ade Williams 
memieemene GueStTION as to the effect of tnemrype ose te:— 
fomeron On power of the tests for hypotheses concerning main 


Emeccs asswell as interaction in the factorial ANOV desaon, 


Dy POWER OF THE TEST 

moveteOor the test 1s défiined as the probabilte, seme. 
Meerine a false null hypothesis. Power functions have been 
fewewoped £0Or parametric tests, Since these tests are based 
on assumed known distributions. Power curves for parametric 
Pyemetests are contained in the Appendix to Reference 10. 
Mitewot the arguments for entering these curves 1S $, a func- 
Mmmnor the factor non-centrality parameter and error vari- 
ance. Formulas for obtaining the argument ¢$ for ANOV designs 
Mewelvyine interaction are contained in Reference We 

Suepel (12) proposed that the@pemwer Ofenon-parametiic 
tests can be expressed by comparison with the most powerful 
erersting parametric test that 1S used for the same purpose 
sercee no power functions exist for =the “distribution—-tree 


non-parametric tests. Siegel pointed out that the more 








general the non-parametric test (the fewer the assumptions) 
the less powerful the test will be in comparison with a 
parametric test involving the same sample size. He further 
Seared that the Fetest, because of its strong assumpit lemme 
meehne most powerful test of 1tS type. Siegel calledginms 
pemer comparison concept “power efficiency.” it 1s a func- 
imo ot the increase in sample size of the non-parametric 
Memeover that of the parametric test which 1s necessary 
to make the two tests equally powerful. 

Mteemeti ically, the power of a Statistical test.a ora. 
teeerc Or Non-parametric, can also be estimated empirically 
Moroueh computer simulation. A simulation model for a par- 


meeilar ANOVY design can be constructed and data generated 
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een the data. The null hypothesis, that the "built-in 
puae-Ge 1S not present, is then tested at a desired llewel of 
meee cance. Power at the desired level of significance 
is measured by taking the ratio of the number of times the 
mmse Null hypothesis is rejected over the number of times 


fmemrest 1S conducted. 


JB EeePOSE OF THESIS 

ties purpose Of this thesis is to develop a2 computer 
Simulation model for obtaining a power comparison between 
the parametric ANOV F tests and the non-parametric Wilson 
Oiu-Ssquare tests under varying conditions of unimodal error 
non-normality. It is envisaged that the general method will 
bemapplicable in determining the power of other Non-paramee, 


mie, tests. 
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A. ANOV DESIGN AND GENERAL PLAN 

A 3x4 ANOV design with six replications per cell was 
muoocen because of 1tS general nature and because it wased 
meued CO Compare interaction detection capabilities of the 
feaeeson and F tests, as well as that of main effects. The 
fememod developed is presented in five parts: characterizing 
meer, Characterizing interaction, the data simulation model 
Pmemecomputer program, and determination of test replications 


mememcesired confidence. 


Be PiARACTERIZING ERROR 

Only tmimodal error was considered. Error was charac- 
jememzed as Skewed, leptokurtic, and platykurtic. Four dégrees 
@mmeoech type were considered, from violent to almost normal. 
The degenerate case for each error distribution type was the 
normal error distribution and this was considered as a fifth 
degree. Each degree was identified by Pearson coefficients 
8, and 8,. For continuity with Pearson's work, some degrees 
were chosen identical to the error distributions studied in 
Memerence 1. All error distributions were selected with a 


mero, Of 0 and a variance of 4. 


c.. CHARACTERIZING INTERACTION 


inmveract lon was characte til Zvedeas eto ments: 


r ikea tree 
easy ot jel,++,4 @) 
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where o, 8 were constants, evenly spaced; incereacingsane 

: C. = 0. (Note that the “evenly spaced” andw iam ey-acamee 
features are not required.) This Characterizationsne sume 
imeic Interact ron CiLfecr, TO Deine Proportion aaaee 


thie effect of factor A, Os and increasing with each level 


omeractor B. 


De THE DATA SIMULATION MODEL 


iene time Mathematical Model 


5g PLL RTT Soa mE eS Fe (2) 


where 


233, represents the error which under the ANOV assumption is 
@metributed N(0,co*). It was the distribution of this error 
Meme chat was changed from normality, but with a constant 
ferwance of o” = 4, in order to determine the effect of non- 
normality on the Wilson and F tests. The development of 
equation (2) into the twelve cell models shown below is con- 
Mame ad 1n Appendix B. 
Meeel or cell one. 


York 7 Ht oy t By + COB), + 249% K=1,+*,6. (3) 


Model for cell two: 


Yiok ~ Ut % * By + COB) > * 2 2% ar 2 1) 
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Model for cell three: 


x¢ + (a8), + 2425 k=], °* Ose) 
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Model for cell 


(7s aug sme 


(OB) 2 + Za, 


Model for cell 


Selec 85 


Model for cell 


op 5 * BD 
Model for cell 
Yo3k 7 H+ oO * Bs 


Model for cell 


at pT 


(OB)oz * Zax 


Model for cell 
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Model for cell 
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Model for cell 


Yau, = U7 Oy 7 Gy 


SG 


LOI: 

- Bo - Be - (aB)44 (a8) 4. 
k=] 5 sie 

iBT WAS 

‘ (0B) 54 + Zoi, k=1,°°,6. 

Sel; 

+ (08) 45 oor k= re AG. 

seven: 

* (aB)o5 * 2934 8 9 9 

eight: 

eg 5 RE een, 
= | erenerOe 

mane 

Cr mC) neva 
Kad) se se 

ee i. 

aoe ae (ab), 5 (a6) 4.5 
k=] See oe 

Celie 

POR eis (a8),2 - (08),. 
k=) oe 


EZ 


(6) 


(7) 


(8) 


(9) 


(10) 


(11) 


(12) 


(13) 








Model for cell twelve: 


Yzay Se a a = oo, a By = Bo i Bs + (OB) 44 3 (a8), 5 


SAGE) OE i Oo ee 


k=1,-= 60a 


PrOGcedUTeSeLOr SeNer at icc it Om muda enero Bi a and 
fommacterminine the parameter values Oa» do,°°*,(aB),2 are 
Pomme below. It may be noted that Several of the parameters 
mmeeruation (2) havegdropped out of the tweive celi models 
as explained in Appendix B. 


mee ocCwe rab Vol Of aro. Zak 


we NOrmal. Ex rome Distribute vom 


Se. CUM aes 


4. — = so SB cy lk _ sy 
DAS | 5 ee ee | bee 


af (Be ty ns ar sanues 
ior 8 ees Bee 


<a 
-er.ge ¥ t 


i 


oitees OL 4, were generated by using the central limit approach 
contained in Reference 13. A normal variate z was made by 


applying the following simulation formula: 


- 





1 kK 
z= 9, sal > P; ; 5] “Hh, Lo, 
i=1 
Where ; 
ee desired mean of the normal error variate (here=0), 
oes desired Stqan@ardedeviaderen Of the normal, errom 


wate (here=2) , 


a Unitorn 10.) random mumbe — eam d 


de 


lI 


k number of random variates desired for approximating 


a normal variate by the central limit approach. A value of 


5 








K-12 was chosen for convenience Which reduced ms mitre 
IZ 
Ziti’ 1G y or, - 6.0), (16) 
1=1 
be okewed hrron 01 Stra bie ron 
The most violent degree of skewed error was an 
Eeenential distribution and was generated using the expo- 
Hiem@ital generator shown in Reference 13. Advantage was taken 
Smetne fact that 
ewe xD — Z 
2 
MZ 
and 


Dh oe eae ros ae (17) 


jmrere Zin this case 1s an exponential variate with desired 
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mean of ji, and desired variance of oF ae 
z was then transformed by the below formula to obtain a mean 


On 0. 


The other three degrees of skewed error were 
pemenaced with the gamma (erlang) generator of Reference 13. 
iieesimulation formula was developed from the probability 


Wemoity function (pdf) 


ok , (k-1) atz 


ie Ze > (aa (18) 


mitere a > 0, k is a positive integer, and z is a non-negative 


Serikange Variate. Here 
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Erlang variates were made by taking the sum of k exponential 
Variates, 


k 
1 
b= fe) te Ts; 
i=] 


k 


ome |x 
Z A log \[r, ; (19) 


i=1 
Sac e H had to be ereater than 0 an tie Sima toneco uae mer. 


(19), the below transformation was used to transform the 


i | 
wer aww we rt 
PY — — 
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ra) Ame! 4 oe (20) 


iitmemcniree combinations of a and k chosen to generate the 


three levels of erlang variates with mean 0 and variance 4 


were. 
a Kk 
Ze 16 
1.0 4 
V2 /2 Ze 


Ce Lepucokurtic Error eis tripmenen 
The four degrees of Veptokurtte er(oreyc i. se 
erated by sampling from an empirical cumulative distribution 


mumetion (cdf). The below pdf equation for a type Vil 


ibs. 








Pearson curve (leptokurtic) was obtained from Reference 


i 
x2 \ om 
a 25 
a 
where 
2B. - 9 
aisle: AG 
ae 
aL a are and Wey = desired variance = 4, 
2 
ae ees el) and N = number of desired 
avT lr (m-4) variates in the 
distribution 
and 


mK abscissa index value for the associated 
Smemmate density value, y. 

Smemwonndred index values from -12.0 to + 12.0, six standard 
deviations, were used in making an empirical pdf by computer 
geemlation. A routine was incorporated into the program that 
Camculated the mean, variance, unbiased estimates 8 and 8, 
and frequencies at the 100 index points (i.e., histogram 
fjemuencies). This was done to insure that the error gener- 
meeeewas accurate. The pdf was converted to a cdf by succes- 
Sively summing the pdf values along the same horizontal axis 
meee tO t1Z2.0). A Uniform (0,1) random number was then 
eemerated and used to sample from the empirical cdf. A 
bamary scarch technique was incorporated in the computer pro- 
faom at this “sampling” stage to reduce computer time. The 


mucin Variate was determined by interpolating between ene 


Pwo index points on the horizontal axis which bracketed tire 
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probability value from the edf that corresponded tome ucan. 
pling random number. 
do) Platykurtie Eveor Dis@rubueden 
The four degrees of platykurtie error were sen 
emeaeed by a Similar empirical cdf sampling method 5 (seman 


eawaeion determined from Reference 3 for a type II curve was: 


x2 \n 
=e. a (272) 
a 
where 
5B. = 3 
m= 
2(3-B4) ; 
Zin. 6 
eee ee 
on Bo 


Nt RF es Sh ‘ Ny 
BS cee 
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y pa ee 
O ha lr (m+1) 


”~ 


meeeeitlar routine for calculating mean, variance, Bas 8, 
and histogram frequencies was also included in the computer 
Meeoran fOr platykurtic error (and also for skewed and nor- 
ieee rror) to insure that the results were as desired. Se- 
feewed Computer programs are attached followins the appendices 
mampenis thiesis. Smooth histogram curves for the degrees of 
aemrerror type are shown in Appendix C. 
Bae Model Parameter Values 

Themiiaelsommtest was the first Claimed distribucion 
fmeemmethod tor testing interactions in the ANOV model: @ihiere. 
fme actecrmining the power of swclean»interageion Teseaee 


[mor inary Consideration. It was desired to chose parameters 


for the 3x4 model (equations (3) through (14)) which would 


ne, 








Guarantee that the power of the Parametylem (too estore. 
teraction would be in a sensitive rangewom the ANOVse we. 
eunve. After studying the appropriate power Curves 
momeeppendix D, a desired interaction test power on WO/7swis 
@rosen.  Ihis gave a ¢ (Curve argument) value Of Seoeeyonk 
miospackwards from this, subject to the conditions given in 
Peenaix B and the chosen interaction characterization, the 
below parameter values were determined for equations (3) 
tiarouch (14). See Appendix D for development and computa- 


Erons . 


vp = 100.00 

a, = a 

ee = O26 

By = ibe 0% 

Bo = alas 

B, = sO S 
(OB), = 4 O52 
(08), > 5 0.4944 
(ab), = 0.4944 
(CoB) 54 = -0.4032 
(0B) 45 = -0.1344 
(0B) 52 - Onl oaae 


om THE COMPUTER PROGRAM 
The generation of error variates was incorporated into 
fac Main computer program. A different “package” was written 


mer cach degree of each error distribution type. Six diitervene 
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replication of error variates were then applvedsinece a cmon 
mene 12 cell models to produce 72 observationsmmerere ti 
bpethe parametric ANOV F tests and ithe Wilsonmeinn sauce 
estes. 

Separate Subroutines were writtem for the pananermure 
Piim@weand Wilson tests. F and Chi-square Statistic values 
tome computed for main and interaction effects. 

In the main program these computed values were compared 
memence threshold values from the F and Chi-square tables at 
maemes per cent level of significance. Jf the calculated]? 
Smee -Sduare value was greater than or equal to the thres- 


hold value, the false null hypothesis was rejected and 


weeumted." The total count was then divided by the number 
Memeiines Lhe Cesl was conducted £0 Gutain tHe Power Of tne 
Gest . 


Flow charts of the main program, subroutine ANOV, and 


Suemoutine Wilson are shown in Appendix E. 


Rae PebeERMINATION OF TEST REPLICATIONS POR DESTRED (CONT Spr ies 

Stein (1945) showed how a sequential sampling procedure 
ema be used for establishing a confidence interval on fixed 
length e for estimating the mean up having a confidence coef- 
imeerent > 1-a. 

ints procedure was used to €Stablish the miumpen Od ste oc 
memltcations (N) necessary to obtain at least 95 per cent 
Sominaence of being within +£0.02 (e = 0.04) in determining 
mewer of the test for the three F tests and three Chi-square 


tests. 


GS 








Stein's theorem and proof are contained ine hewerc mec 
14. Application of the theorem to obtain N is shown in Ap- 
pendix F. The computer program utilized 1s sateceie deel. 
moe thesappendices, The mesultewas N = S70GpeenIsesce cic 
foamun of the replications requ@red for the Six teses- 
The deciding test was the Wilson Chi-square test for the A 


igew) effect. 
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TII. VALIDATION 


ie DETERMINATION OF THEORETICAL POWER, ANOV TESTS 
As stated above, avdesired™power of 0567" foremiew ao 


mimetraction test was used in detérmining the simulation 


fea@eieparameters. Using the below equations from Reference 
1 Les Yr 
he 527 a? 
Pal 2 
Oh = : and (235) 
© aay 
= 2 
Tier 2) oe 
De ok > 
B= —~—— , (24) 
ore 


and substituting applicable parameter values, theoretical 


Wenens 1Or the testing the A and B main effects by ANOV F 


ea 
q.\- 


WP) 
(Dp 


Mame round tu DE U.Gl alu VU 9GeMesSoecUInsiy. Wome 
Smemetons and the applicable ANOV power curves are contained 


iieewopendix G. 


Be ANOV POWER SIMULATION RESULTS, N(0,4) ERROR 

Three thousand-seven hundred data cases with N(0,4) 
error and the predetermined model parameters were tested 
with the ANOV subroutine. Power was computed and compared 


Pememeehneoretical power. 


EP Ee A B AxB 


mheoretical Ww Deo 0.96 0.67 
Midd) Error 


Simulated W/ 0.808 0.960 0.665 
wie 4) EB pom 


ZAI 








On ACCURACY CHECK OF WILSON SUBROUTINE 

One hundred data cases with N(0,4) error and predete:— 
mined model parameters were tested with the WILSON subrou- 
mime. Printout was made om median calculationemconting me, 
fmke, and Chi-square values (total, A, B, AxB). Fivegon 
Milemcases were then selected at random and the same values 


fewee Calculated by hand. Results were exactly the same. 


De Sal lON OF LEVELS OF SIGNIFICANCE 

Parameters of the simulation model, other than the over- 
mimeemcan, were set equal to zero. Then 3700 data sets were 
meeancea with N(0,4) error and tests conducted with the ANOV 
and WILSON subroutines. Based on this sample size the true 
Meyets of Significance was estimated within plus or minus 
Ueeemwath 95 per cent confidence. That is, by choosing F 
tment -square threshold values for rejection at the 5 and 
Mmimeer cent significance level, the chance percentage of 
fepecerons should have been equivalent, within the criteria, 


momomos and 0.10 for each of the ANOV F and Wilson Chi-square 


bests, Results were: 

S PER CENT REJECTION THRESHOLD 

EFFECTS A B AxB 

ANOV F S565 S55 .0508 

WILSON x? 0586 .0486 eel 
10 PER CENT REJECTION THRESHOLD 

EFFECTS A B AxB 

ANOV F .1051 .1089 0995 

WILSON yx? pare 0884 0954 


Zed 








Here lesen s: 


Three thousand-seven hundred data cases tornse clo meen 
iene deorees of skewed, leptokurtic sand plactyiiiet tere wo 
were tested with the ANOV and WILSON subroutines. Results 
emesciven below in three tables. Each table gives the 
Memer Of the test for the three effects hypotheses with a 
Memeeicular type error. Pearson coefficients are shown for 
reference, as well as the actual means and variances of the 
Sigor aistributions generated. The last column of each 
mame eives the power of the test with N(0,4) error for 
@Gomvenience of comparison. Error degrees shown correspond 


Meme Curves of Appendix C. 


vA 











1 3 4 5 
Side iD B,=3.97 ByFl.95 B,=9.99 B,=0.20 B,=0.00 
ERROR B4=9.03 B5=9.96 B=4.57 B5=3.47 B,=2.95 
Digs! 'N (EXPON) (NORMAL) 
COMPUTED DIST'N 
MEAN 0.00 00 O00 0.00 0.00 

COMPUTED DIST'N 

VARTANCE Cpe: .98 ON ats SO S26 
tee) at = «(CO 
O 1 

2. 
Hy? y OF i 0 
POWER ANOV OmeSiZ neo ea Z 0.82 ORs A 
POWER WILSON ee 64 2578 Uaioe OR: 
SS = 
Hy: i B 0 

2 
Hy: y BS x 0 
POWER ANOV 0.95 O15 0.96 0.96 io 
POWER WILSON 0.97 91 Oe 65 0.78 0.74 
Hy: yo ceo) e = 0 
Hat 2 (a8). 7 0 
POWER ANOV OG mays Oa OGG 0.66 
POWER WILSON OE Se 8. O27 eZ OS25 
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Enh@i. DE GRinbs 








ERROR DE GRiigs 





1 2 % 4 5 
LEPTOKURTIC B,=0.00 8, =0.00 870.00 6, =0.00 B,=0.00 
ERROR B,=20.00 B4=7.05 B,=4.10 B,=3.40 B5=2.95 
ees Tt N (NORMAL ) 
COMPUTED DIST'N 
MEAN -0.10 -0.11 -0.12 -0.12 0.00 

COMPUTED DIST'N 

, ae 
Ho: } one 0 

2 
Hy? y, Ot § x 0 
POWER ANOV (ies Z 0.81 0.81 0.81 0.81 
POWER WILSON 0.56 Cress: 0.50 0.48 0.47 
— nh eee EM 
Ho: »}, BS 0 

, 2 
Hy: bee: Ff «CO 
POWER ANOV 0.96 0.95 0.96 0.96 0.96 
POWER WILSON 0.86 OLY Caves O75 0.74 
Ho: 7) Coe) ae = 0 
Hy: ») (0B); # 0 
POWER ANOV 0.68 0.67 HOG 0.66 0.66 
POWER WILSON O50 0.29 Operas: OiseZe5 O25 


us 








ERROR DEGREES 





i 2 & 4 5 
ReealYKURTIC B,=0.00 B,=0.00 B,=0.00 B,=0.00 B,=0.00 
ERROR B,=1.80 B,=2.00 B4= aw AlS. B4=2.50 B4=2.95 
DISstT'N (UNI FORM) (NORMAL ) 
CO MwPureED DIST'N 
MEAN 0.00 = 0520S -0.05 -0.06 000 

COrePuUITED DIST'N 

VARIANCE 597 a S207) See 5206 

2 _ 
Hy: YY oe 0 

2 
Hy: y o§ # 0 
POWER ANOV Or on OLA ters Oreo re 0.81 
POWER WILSON Ones 7 U4 0 42 0.44 0.47 
Hoi BS = § 

2 
Hy? y “ # 0 
POWER ANOV 0.96 0.96 O26 0.96 0.96 
POWER WILSON G55 (60) O55 0.68 Oia 
HH: ape (Clee = 0 
Hy: Dy, (08); . - 0 
POWER ANOV 0.65 CaS 5 Ces Gro 5 0.66 
POWER WILSON 0.18 0.20 Oe OAS OSS 
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V. ANALYSIS AND INTERPRETATION OF RESULTS 


A. Py POTHESIS MEST POVER CURVES 

Bigures 1, 2, and 3, which are attached followin meee 
Section, compare the power of the ANOV F and Wilson Chi-square 
moc by the null hypothesis being tested, Each ticure  wcon- 
Poms three sets of curves, one for each error distribution 
mgeee «Ihe horizontal argument of “error degree" corresponds 
Pemene aegree of non-normal error distribution type shown in 


Mmmemaistribution curves of Appendix C. 


iB. ENOVY F TESTS 

Figures 1 through 3 show that for a 3x4 factorial with in- 
teraction and 6 observations per cell the power of the F test for 
weemect tects and interaction effects hypotheses are unattected 
Myamteme three types of error non-normality. The range of power 
Siaange from the estimated power with normal error is only 
meee to + 0.02 over all three hypotheses. It appears thac 
@itemesshould be no concern relative to degradation of the 
power of the F test because of error non-normality, even in 


extreme cases, as long as the data is unimodal. 


on hiGsON CHI-SQUARE TESTS 

the below curves indicate that the Wilson Chi-square 
Beets are not “distribution free" as claimed. The power of 
mute StsS fOr main effects and interaction ecfreces arenocn. 
Seeive to the shape of the error distribution. 

The normal error power estimate for the Wilson A effect 


test was 0.47. Non-normal error in that the test resulted 


27 








on a range of power change of -0.10 (yaclent platyiniutie mere 
£0.27 (violent skewed) from the normal value. For the Bet 
mect test the range of power change from the towmalweuron 
peusmate of 0.7/4 was -0.19 (violent platykurtic)) to 2072 
ieeeelent skewed). For the AxB effect test the rangepon 
power change from a norm of 0.25 was -0.07 to +0.11, with 
im@emcame Crror type extremes as before. 

iieceneral as expected the powem of GhewWil sonmmeni= cdi same 
miomoewere lower than the power of the comparable F tests. 
Dmemeche e€rror distribution was N(0,4) for both, the power 
Meammecmcili=Square test for A effect was oo pe! Contre mecnc 
ferereot the comparable F test, the power of the Chi-square 
Mmereeor b effect was 77 per cent of the power of the F test, 


— fe, = o o =~ + CN -- w+ me tt ~ igs om ~~ 4 - e S id UN) 
eC ei SOQ Uaine LOStC ECT AXBD EC€LLIeCtu Was Oo 


Ft, 


Premeele PCWCY O 
fiommecit "Or that of the F test. However, there was one case 
Miemesthe power of the Chi-square test was higher than that 
Seaeeie FF test (0.97 versus 0.95 in the test for 5B effect un- 
meme CONdition of violent skewed error). 

mine error effect trend for a particular error type was 
@eemcistent over the three hypotheses tested. Note the simi- 
mie in shape, for example, of the skewed error Wilson 
Mewerecurve in Figures 1 through 3. The rate of change in 
Bower with respect to error degree (as error varied from 
Memmality) was, however, significantly less for the Chi- 
faire test for interaction under the three error types than 
it was in the Chi-square tests for both main effects under 


momivalent error types. 
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A. 


femputions of the Wilson 
Gm@emalternate hypotheses 


pane r distribution. 


Vil eisSeussloy 


Wile SO) Nim lide oreo) Poet cone) y alee 


fe is apparent from Figures 1 through™3 thae thes 
Chi-square test Statistiecmumdes 
are SCNStE1LVe tO Che wSiape se ueeme 


The question arises sas) fo Whetleneeme 


fmeeributions of these statistics under the null hypotheses 


meemeersO Sensitive to the shape of the error distribution, 


elas 


ms, whether the type I error (alpha) is changing with 


Pacem degree of error distribution. 


were 


tion 


ieminvestigate this, level of significance estimates 


mre under the tour degrees of skewed G€rror distribu 
merce terminine pCwer With Une gedes Vege meee ee 


E@meaietO zero and Chi-square threshold values set for 


alpha = 0.05. 


Results were obtained and compared to level 


Pmeoroniticance results with N(0,4) error. 


A B AxB 
WILSON SKEW #1 .0624 .0524 .0489 
WILSON SKEW #2  .0659 .0530 .0432 
WILSON SKEW #3 .0659 .0530 .0432 
WILSON SKEW #4 .0649 .0524 .0454 
JILSON N(0,4) 0586 .0486 .0411 


Although the true levels of significance were slightly higher 


under the skewed error, they were higher by approximately the 


same 


amount in all cases. On this basis it iS comeliiccdiee nae 


OW 








eye distributions of the Wilson Chi-square sstaticcn nemo 
ecmsitavesto the error distribution under the alternate 
MOLMESES. 

Sincesthe test as proposed sbyeWilson uses Meme. Chiesa 
Pemmeic appmoxXimate distribution of the test statpst rece. sic 
eeemtgent that this approximation does hold under the null 
ipgeomnesis (at least in the right hand tail of the distribue 
fren) but that the degree of approximation OfFthe nNowoec imc 
Smeesiarc under the alternate hypothesis 1s sensitive fo 
mmemees in the error distribution. Sawrey [15] has labeled 


memecests as ''semi-nonparametric.” 


Be emer THE WILSON TEST 

wie above should not be interpreted to mean that the 
Bamecon fest 1s invalid and should be avoided. It 15 obvious- 
Mmepmirrcri1oOr to the ANOV F test and should not be chosen when 
@iemcdata permits utilization of the parametric ANOV. How- 
pee the Wilson test, to the author's knowledge, is the 
Semelest of only two procedures applicable to testing for 
gnteraction when the data is qualitative and measurements have 
Meemecbtained only on an ordinal scale (see Mood [16] for the 
meer. It should be used in such cases with the realization 
mitesits accuracy depends upon the shape of the underlying 
Seeor distribution. After histogramming the data, the re- 
oeus of this paper may be used to provide general insight 
melative to the question of what power to expect. Pertinent 
fewer estimates for a particular design may be obtained by 


employing the computer simulation method presented herein, 


HS 








provided that the error distribution (unimodal) ,ean)bemmden- 
tiiduved from the data and the type interaction Gan be scmamie- 
iMemized. Twenty-eight and one hali minutes @mean [eine 
Gomucer were required om’ the average in this study forgep- 
Pome power estimates for the normal case and one nen- 


mere error distribution. 


C., PeeeAS FOR FURTHER STUDY 
me rower Eriiciency 
Reeypleal QueStiOn fdeiInm’ a prespect i Veomuscumer Cir. 
Wilson test is that of how many replications are necessary 
ieeieea Darticular design to attain a desired power, given 
pmeeeercular error distribution based on preliminary sampling. 
This is a problem in estimating power efficiency for the 
feeleerom test and 1S a natural extension of this study. The 
Same simulation model could be used. 
@mumeeliaierent Type of Interaction 
The present research could be extended to include 
emmemeciaracterizations of interaction. In the Course of 
Miers tudy the author at one stage characterized interaction 
by Cole 


Aieeatches of data, indicated that the estimated power for 


my ©: + Dae InecempleteceseSults = pased fom emny, 
Mlemee tests was the same as that for the charactcrization 
meme herein (1.¢., GE) 5 2 mee eo but that the cs tiiiaued 
power for the Wilson Chi-square tests was considerably dif- 
ieee trom that under the present Characterization. 

bem itecet OF HOmOSCadacrty on Power 


It is believed that a computer simulation metned, 


Silamerc tne one used here relative to non-normality, coum 
a 








be used to study the effect on power of the parametric ANOV 
mequarement of homoscadacity. Error distryibutvonsce coum 
penerated with different degrees of error variance, data 
tested by the ANOV and WILSON subroutines, and the results 
Paley Zed. 
4. Semi-Nonparametric Tests 

Another research area recommended Ws that oben cena. 
iemearanctric’ tests. An appropriate thesis might consist 
Semeetcracting all such tests from the literature and then 
sieving why they are semi-nonparametric with resulting im- 
Pueeeat2ons. Reference 15 would be a good Starting point 


momeescuch a thesis. 


feet tect of Sample Size OD NOD SMO rill 1 Ged BeCt 

A final extension of this study might be to analyze 
Mmlewetrtect of sumple size (replications per cell) on the power 
eee ANOV F and Wilson Chi-square tésts under the Same con- 
amrens Of error non-normality. Would a doubling or tripling 
mmsamole size tend to flatten out the Wilson power curves 
wievrein Figures 1, 2, and 3 of Section V or would they just 
be shifted upwards? Would the ANOV F tests still be unaf- 
roomed Dy Crror non-normality 1£ the sample $size were only 


fmeemreplications per ceil? 


os 





VIT. SUMMARY 


A complete simulation method has been presenteduia, 
estimating power for both parametric ANOV tests and Wilson 
non-parametric ANOV tests. <A 3x4 ANOV simulation model 
Wa@eeused with six replications per cell. Interaction was 


Smameacterized by (oR) = a, ¢ with 3/8 constant, in- 


J 
Seong, evenly spaced, and © c. = 0 Error non-normality 
was Characterized in four degrees of three unimodal error 
G@ierripution types: skewed, leptokurtic, and platykurtic. 
iets shown that when the error was normal the Wilson Cnai- 
womlame test for A effect was 58 per cent of that for the 
@emimeradble F test, the Chi-square test for B effect was 7/7 


: aa bal o = . os —_ ee a | « 4 rut - _ r re _ a 
PRM cs Tat LOT Tne §F COSL, Ga Une Cini -squcre res. 


© 


Pemmeexb Crtect was 38 per cent of that for the comparable 
[ere it was further shown that the Wilson Chi-square 
Veweemwere not distribution free as claimed by Wilson but 
tememoenmsitive to the parent distribution shape. Lepto- 
Mere and Skewed error distributions increased the power 
Of the Chi-square tests above that estimated with normal 
eameme Platykurtic error distributions decreased the power 
@aeene Chi-square tests from that estimated with normal 
euuenr. lhe power of the ANOV F testsS were unaffected by 


even the extreme cases of error non-normality. 


36 








APPENDIX.A: DESCRIPTION OF fei iS ON ios 


1. The median value, Mg: for the entire set of n oab- 
Semvations is determined. fhe number of observationseicc.: 
than Ma: represented by Ny » is then calculated. 

zZ. A 2xrxc contingency table 1s Ganstructed where: 
and c represent the number of rows and columns of the de- 
feomeand the "third dimension 2"' corresponds to the divi- 
Sion of scores by Ma: Tne, Erequeiney.e tet Ve ca One 


@emmeency table are represented by rit the number of 


cei 
@eeervations less than Mg For the ceil ineirow 1 and column 


feereecie table. It follows that 


1EN 
ee) 

t 
| 
—/ 


n. = yy Y. Soe ae 
; 4 


us ~ S isee 
J 
iitembelow contingency table example is given for the purpose 


Seow aritying notation: 


M, = 100.54851 


d 
PACT ORO 
1 2 3 4 aie 
il = 6 2 2 ie 
FACTOR 
B 2 3 2 4 2 11 
5 4 4 hi i 10 
£ iy y 7 S 36 
es oa 
al 1 
if ee 


oy 








T= taed 


Cle 
ae = # observations < Mg 
ny = 36 
1) = ae A 


me ocince the number of observations for eacnvecmunnnm 
the ANOV design of interest are all equal and My can be cal- 
culated such that i = n/2, the total Chi-square valuemecm 


be computed as follows: 


Xp = La b 2 a3 ; Bs} (Lea) 
i) 
where n/2rce represents the expected frequency under the null 
Memotnesis that the main effects and interaction effects 
produce no change in the distribution of scores. Xr has 
(re-1) degrees of freedom. 
4. The Chi-square values of the row effects and column 
eeecets are computed using the marginal totals of the Zxrxe 


Someimecncy table. 








2 _| 4r : oe : e 
XR 4 2 fi. ad (lis SS) 
and 
2 . |4e eas : 
XC 7 | on | 2 fr Z| oe 
; 13 eS: 2 
where pig. : nag and he os jaa As before, the sexpee 


ted frequencies for the main effects, n/2r and n/2c, are ob- 
meimed tor the null hypotheses that the distreputions or 


meares are identical for all levels of the row or Colum 
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pELe ets. XR and XC have (r-l) and (c-1) degrees of freedom 
respectively. 
>. The Chaesquaresvalue for the 1nte@nvactionmset femmes 


Geamputed by subtraction. 


| See. ieee ¢ nD Cs) 
XT has (r-1)(c-1) degrees of freedom. 

6. The tests for the main effects and interaction are 
made by comparing the obtained values of XR Xo» and XT with 
waeees trom the cumulative Chi-square distribution for the 
Ppmmecpriate degrees of freedom and desired significance 
eve. 


fee wilson [6], citing Rao (1952) and Cochran (1954) 


Pee Pee Wes eu 4.1, 
a4 ut 


a 4. 1 ON | . 
= In aN en ~ oN e& Se a ww nm tA nm NR We VEIN Aa 
tere boat. § aD Vs —wS + oo ~~ 


Demme trequencies as long as the contingency table has 30 
mmemene degrees of freedom. He further coneluded that 
omammary Chi-square tables were applicable as long as the 
30 degrees of freedom criteria held. 

fe Nilson (6) ancluded formulation for Chi-square 
values when a the number of observativens Greater thanwon 
equal to Map is not equal n, and when the ma are not all 


swum in addition he extended application of his test fo 


experimental designs with other than two factors. 


os 








APPENDIX B: DEVELOPMENT OF 2 25C EL iO iia 


1. The Mathematical Model 


| Dd orgs. Jo Ley 4 ee = ee 


| 
| 
Mmemexpressed in matrix notation as 


. = x B + Zz 





Your 1100 | | od Ai 
: ’ : : : : “Ay : 
Yue 11001 | ae Zuo 
; eee: B2 : 
Y126 me Ca | Bs 2 
1100. | | - 
re on a3 2131 
Yisc_ | 1100 4 | Aafia | ae 
Se : . ia dfs | | eee 
; : ; : ; . » AB-22 . 
_Yi46 1100 | 2 A323 
\ Neg 
ne , : ; 0 : api 
Y216 1010 | | pees 
Y221 el | AS 34 
_Y226 Polo | 
Y231 ee | | 
Y236 Lolo | | 
Y246 1010 | | 
en LOOT | | 
Y316 foot | 
or | 00 | | | 
N326 HOOT | | 
¥331 100 | ! 
Y336 100] | | 
Yet | 00 | | 
Y346 IM 00} | | 
7 2x1) (72x20) (20x11) 
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2. ~Model..conditionsmewre. 


SP | SP ae 


(0B) 54 
ey ai 
ad 
(Oe 


(oB)> 3 


CoB)i 4 ° 


fee Rewriting the 


Eas 
(0B) 95 
as 
esl 
(0B) 5 


(08) 2. 


© (GB) 3, 


+ 


+ 


+ 


(oB)i4 = 


(AB) 44 


(0B) 54 = 


(2-2) 


(2-3) 


(2-4) 


(2-5) 


(oe) 


(2-7) 


(2-8) 


(2-9) 


above and eliminating, dupliucac some: 


(08) 1 - 
CID, 
ee 
(08) 55 
OG 


(a6) 5, 


4] 


(0B) 13 


= eR 


Gece, 


ee 


(Ze) 


(2-14) 


(2-15) 


(2-16) 


(2-17) 


(2-18) 








onus the matrix equation can be reduced tovan ecalagioneea 


only 12 parameters (vice 20). 
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4, The new new matrix equation is expressed on page 


The following cell models are obtained by expanding the 


new matrix equation. 


| 


| 


Model for cell one: 


ix YO Oy 
Model for 
ipk UT Oy 
Model for 
‘2 ie 
Model for 
ey = U + a, 
CoB) 45 


Model for 
ik =  * % 
Model for 


Took 7 Ut Oy 


hodel for 


we || «(Ul CU 


Model for 


oy MT oS 


(0B) 55 


Model for 


ae 


ea 


Pan, 
eel) two: 
* Bo + Cab) > * 219, 


cell three: 


3 + CoB) , + 2434 


Geld Vt owie: 

7 B , 7 Ba : B a. (a8), , 
(oB)i 3 * Zr 4% 

cell five: 

Sey te aa 

ce ilesi x= 

We ae ea 827 

ceil seven: 

z + (aB)o, * Zoax 

cel easent 


= By : B 8. = (AB) 54 


CoB )oz * Zon 


cell nine: 


- a, + By - (0B) 44 - CoB) 54 


A2 


k=1,°° 


6. 


Var 


(2-19) 


(22) 


(227 


(=o 


(es) 


(2-24) 


(2-25) 


oe 


(2-27) 








oe |e ae | py Zl 
ane ‘ a“, 
» U/ s e xX ; 
eet | By _ 2116 
a Bo A12\ 
[OTe | ie Z126 
etl <0 | | fl Zist 
the A312 ‘ 
Ese ane 6, | | 713 _ 2136 
= 1 | O-t-l mt npn 7 oP | + Ziti 
i. ee ee K322 2 
1} Oa ay 4-4 L Bas 2146 
| Oi | aly le 
4 ¢ : i ck 2 
ce | ZIG 
laeOr «| | | Fou) od 
PO: | | _ 2226 
Omi | | Zo 
ee : } 
t Al ‘ i ' \ —7 oe 
' ws t t t - a 
eG op) mali + -| -| | 2241 
OSes) elec | sah S| 2246 
| -| -| | ~| ~| Lay 
Viele hes -| at ZIG 
; -l -l | | —| Zot 
r) b . 4 6 Ld ® 
2 ' e a > t a 
i -1-l —| =| Z32G 
sla = ~| Fae ea 
> ‘ 2 s cy : ? 
ale | =| ~| meer 
| =) -|=!-| -| | 7 1 I Eee 
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Model for cell ten: 
Yee a ee iD 


" aa 


Model for cell eleven: 


Yo3,p 7 H- O - % + Bz - (08) 12 - 


Ea 


Model for cell twelve: 


(08) 55 


k=1 5° ie eae 


(08) 53 


k= > Wo 2 


see = OB OT 


a 


+ 


CoB)oz + Zany 
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CoB)i, + (aB),. + (o8)5, + (08),, 


k=1,°°,6. (2-30) 
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APPENDIX D: DEVELOPMENT) OF MODES aes 


I. the power curve for determining theemet ical im 
mer the test of interaction, 3x4 ANOV model, 15 attached 
[er cthis appendix. Numerator degrees of freedom are 6, 
(r-1)(c-1), and denominator degrees of freedom are 60, 
ei); where ris the number of rows (3), ¢c is the nun- 


memos cOlumns (4), and n is the number of replications 


Meveecei!! (6). For a desired power of 0.67 at a level of 


Pemeaticance of 0.05, ¢ = 1.3. 


es From Reference 111 


i C 
2 mee: 2) n © yy 2 Z 2 
vie yo | “sere ae | (004 Wes) 


I 
i= 
On 
tO 


ee) 


pumice a variance of 3.98 was actually obtained in simulation 
of the N(0,4) error, this value was substituted for oa°. 
Peyeiies fOr r, c, and n stated above were also substituted. 


iiemeerearranging (4-1) 


3 4 
ye 3 (a8); = HAS 08S) = 7.8387. (4-2) 
i=l j=l 


See Any combination of (a8) 45 °s Suen) that (47) sonal 


halts give the desired power. But the interaction was Char- 


acterized by (a8); = ae. with cs evenly spaced, constant, 
maereasing with B and ; oe = 0. Initial valwes tor e-mivene 
peso arbitrarily chosen as Cy) = o Cy = = hes Cz = taal Cy = 
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fee initial values for a, were also arbitrarily, chesene 


Sopyect to the condition 2 a; = 0, to be a, = -1.03, 
i 
a, = OP Si dz = Ore Ser 
* substituting these yalvesmaonecws ncuron 


al: 


((-1.03) (-3)) 


Bod a5 - 2D, Casey 
1 j 1 j 


| 


| 


rete ((0= 7oaGs) 


SAO Sor. 


mmesecach value of the initial selection for f. was too 
ie 
meee by the multiple (34.0360/7.8387)° = 2.0837. Jnitial 


oa 8 mere then civided by 2.0837 to obtain: 


oS - 1.4 507 a ee 
Cy = = AL a Pe ken 
Cz = 0.47990 = 0.48 
Cy = P4397 =) eae 
Bee USing the original a. "Ss and “Enea ad [US ted ie 
wmebues of (a8) 5 = Gla Ea) were calculated to be 
(aB) 44 = aC) = ees 
(aB),> = Q)C5 = 0.4944 
(aB)4 2 = O40, = -0.4944 
(aB) 4, = a4,C, = = 4 8:52 
(ab) 54 = Q5C, = -0.4032 
(aB) 5, = QC, = SOeele gies 
(0B), = OC, = te Gee 
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(0B), ) = OC) eee Ore 


Dae 
CoB) 24 = a,C, = -1.0800 
(aB) 2. = 420, = -0.3600 
(a8) 2. = O20, = 0.3600 
(a8) 2, = O20, = 1.0800. 


fiese values of 60855 met the modeli@eondi treme: taccdmim 
Appendix B (i.e., % (o8).. = 0, i=l,++,3, and + (a8)... = 0, 
5 i 1 1) 
j-=1,°°,4) P 
G6. Values of - were then (chosen duometaur ly cubjecn 


femtne condition ; B = 0. Values were selected in the 


memenborhood of the as Values "SO. tia elon sini tem iat seis 


LAA peas: s- 2 LA 2 ee. ee Vr Veen = a ee A See a a) = - nN 7 
eS Asa es wa ce hogs Cit pars i berry pe wird tp bis, os << fa wa Oe we. w =. eral 


‘ 
Jt 


8. mo. 03, B = 1.03, By = Oise 
eee ine overall mean, represented bya tim cauatien: 


Meemeenrough (14), was chosen arbitrarily to be 100.00. 
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APPENDIX E: COMPUTER FLOW DIAGRAMS 


Main Program 














TNE TEAS Ze 
PARAMETERS 


a SA 72 
ERROR hie 


MAKE 6 DIFFERENT OBS. 
FOR EACH CELL USING 
Onis (Se ees 


CALL SUBROUTINE ANOV po 












a ae eee RETURN 
/ ARE FA, \ 
; / FB, TAXS ‘ : 
DON'T NO__/ »>THRESHOLD VALUES \_YE 
COUNT COUNT 
POWER FA = TOTAL COUNT FA/N 
POWER FB = TOTAL COUNT FB/N 
POWER FAxB = TOTAL COUNT FAxB/N 
}CALL SUBROUTINE WILSON|~ — — > 
eg RETURN 


WON ' T 
COUNT 












ARE x*A, 
VoB yy AB 
>THRESHOLD VALUES 


Se 








MmOTES: 


POWER x7A 
POWER y7B 
POWER y7AxB 


TOTAL COUNT x7A/N 
ROtALMeOUNi= BN 
TOTAL COUNT x7AxB/N 


N_ TIMES 


‘this package was changed for each level of each type 


ee rOr. 


pelecved Computer programs used are attached follow- 
ing appendices. 


Z.. Subroutine ANOV 





vv ™ La a | fx TS $ 
> Q 
t j f are, 


MATRIX. 
1-6 EQUIV TO DESIGN 
ROW 1, ETC. 






CALCULATE SUM OF EACH 
OBSERVATION SQUARED 
SES10) Es) 


CALCULATE SUM OF EACH 

OF 4 DESIGN COLUMNS | 
AND ITS SQUARE. 

TDJD(J), TDJDSQ(J) 


CAC Tees U ao: 
EXCH On 7 DES tG cr ers 


AND ITS SQUARE 
iD, EDO) 
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CALCULATE SUM OF EACH 
OF 3 DESIGN ROWS 
AND ITS SQUARE 
TIDD(1), TIDDSQ(I) 


COMPUTE OVERALL SUM 
OP OBS ee sous sit epi we 


BY 72 TO GET CORRECTION 
FACTOR 
COR. = TDDDSOQ/72 





COMPUTE TOTAL SUM OF SQUARES 
TS] ec Ole ieee GOR 
Led 


COMPUTE B SUM OF SQUARES 
ft. 

BSS =" 2) TDIDS@()/18 = cor | 
=] 


J 


/ 
COMPUTES a UrivOr SOULRES 


ASS = TID Wee —-cOR 
reall 


COMPUTE See SUMO Ss OUARES 


it 
AxBSS = - TIJDSQ(M)/6 - ASS - BSS - COR 
m=1 


f 


COMPUTE ERROR SUM OF SQUARES 
Boo: = Toomew| hoo SaboS ae So ) 
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COMPUTE A MEAN SQUARE 
AMS = ASS/2 








COMPUTE AxB MEAN SQUARE 
AxBMS = AxBSS/6 







COMPUTE ERROR MEAN SQUARE 
EMS = ESS/60 










COMPUTE F RATIOS 
FA AMS/EMS 
Ei BMS/ EMS 

FAXxB AxBMS/EMS 





1 
4 
{, 
> 


RETURN 






Suproutine Wilson 


ORD Rao 3 ore iy 
COLUMN VECTOR 


FIND MEDIAN OF 72 OBS 
XMED = (YOBS(36) + YOBS(37))/2 


FIND FREQUENCY OF OBS < MEDIAN 
IN EACH CELL OF 2x3x4 
CONTINGENCY TABLE 
IF (YOBS(I).LT.XMED)NBSUM = NBSUM+1 


© 


a 








FIND CONTINGENCY TABLE ROW SUMS 
NBFID = y» NBF(I,J) I=1,..3 


FIND CONTINGENCY TABLE COLUMN SUMS 
S 





NBFID = NBF(I,J) J=1,..4 
T=] 








FIND TOTAL CHI-SQUARE VALUE 


me = Re rE ECT) = oye) 


| BEND CHI-SQUARE A VALUE 





eR GENRE cage 


[ Pine ni -SOUUAIE bp Valu | 


PrN OMCs ORE ax. AGU 


RETURN 
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APPENDIX F: DETERMINING TEST REPLICATIONS 


1. Ten ANOV and ten WILSON subroutines were executed 
on data generated with the simulation model, N(0,4) error. 
Meer Of each of the F and Chi-square statistical tests 
for main effects and interaction was computed by the method 
shown in Appendix E. The subroutines were then executed 
fen more times and power computed in a similar manner. This 
was repeated until 200 ANOV's and WILSON subroutines had 
been executed consecutively giving a sample size of 20 power 
memes per test, each power value based on the number of 


Meese null hypotheses rejected out of ten trials. 


mee ocample variance was then computed for each test. 
i 


Ze oh 
= n -l 

O 

j 





(X, - X)? (6-1) 
=] 
where Xx; is the ith power value and X is sample mean power 
Malue based on the 20 S35 ee 8) 


mmm using the student's t distribution table, fhe 


marue for k was determined so that the following equation 


held. 
Prob] —— <t, ., < —= ]=l-o (6-2) 
2Vvk O 2Vvk 
Where e = .04, ee = Se choc, lala wet Sse 
ee Por each of the Six Statistical tests involved Ny» 


mre number of replications required for desired confidence 


on the value of X, was determined by: 


sh 








S2 
Ny = Max ({ 8] peel "6| (Goes) 


where [S*/k] represents the greatest integer < the ratio. 

wae iie value ob tamed sor Ny was then multiplied by 
ten to obtain N, the number of WILSON and ANOV subroutines 
‘¢ meme ccuted for desired confidence. Ine multiplication 
Setemnecessary since ten replications were required for each 
value of X.. 

foe ine maximum of the N values for the six tests in- 
moved was then determined and rounded up to the nearest 


100. Results are summarized below: 


A B AxB 


N,ANOV = Max (1560, 520, 1670) 


1670p ne (Gen 


Meee lLSON - Max (Scuba B23 See Lo) == Soa 6 UGS 
es 57 00 (6-6) 
Mm—mleterminine test was tme Chi-Square teste tom) ef 


mer. Ihe computer program utilized is attached following 


mie appendices. 
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PEPENDIX G: THEORETICAL POWER, ANOV MAIN EFFECTS TEST 


mace terenec lie ives 
Hf 
, nc y, oa 
OK = ae , os) 
| O aaas & 


ined 


mere n = number of replications, 6; c = number of design 


Solumns, 4; r = number of design rows, 3; o% = desired 
Meriance, 4; and f Os = sum of the squared 0 parameters 
a 


mom Appendix D. Substituting 


_ (6) (4) (1.7018) 
(i ene 


and 


Mme applicable power curve, attached to this appendix, has 


mumerator degrees of freedom r-l= Zs and denominator 
Memerees Of freedom = rc(n-1) = 60. Power of the test, as 


mereetrom the curve, 1s 0.81 at the 5 per cent level of 





Baenificance. 
a 
as = Be 
of, = J ! ae 
2 
crate 
Here > 5 = sum of the squared ae from Appendix D = 4.2436. 
J 
Sb stituting 
ge = C6)(3) (4.2436) 2 4 77 
(4) (4) 
and 
Op = 2.18 


a 








Mie applicable power curve, with numerator degrees of free- 
dom = 3 and deonominator degrees of freedom = 60, gives 


Meer Of this test = 0.96. The power curve is attached. 
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POWER OF THE ANALYSIS-OF-VARIANCE TEST 
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